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The paper describes the use of expert systems 
technology in translating test and observational data into objectives 
for Individualized Education Programs (lEPs) with handicapped 
students. The Math Test Interpreter (MTI ) is designed to combine 
student information, results from the Key Math Diagnostic Arithmetic 
Test and additional program generated criterion referenced test data 
to produce a prescription in mathematics. The Behavior Consultant 
(BC) program applies the expert system approach to classroom behavior 
problems and features two videodisc components. Examples of a typical 
consultation with each of the expert systems illustrate their factual 
and heuristic rules and their use of backchaining to work from 
hypothesized conclusions to known facts. Possible system outcomes are 
delineated, including situations of inadequate information and 
development of objectives for IEPs. The paper concludes with a note 
on the implications of appropriate, clearly stated objectives for the 
education of handicapped students. (CL) 
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Expert Systems in the individual Educa tion Plan Process 

Mul tiuiscipl inary teams must develop individual educational 
plans (IEPs) tor handicapped children (Education tor All, Sec. 

L 19 ] ) • The purpose ot an 1EP is primarily to guioe the 
delivery ot instructional services to a handicapped child 
(Duoley-Marling, 1985). The process ot developing an appropriate 
instructional plan begins with collecting test and observational 
oata. This information is usee to oetermine each child's current 
level ot periormance. A planning team then proceeds to develop 
goals and oojectives, which should match the student's 
pertormance. a review of the research has identitieo several 
proolems which are associated with this element ot the 1LP 
process • 

Problems in Moving from Data to Objectives 

One such problem is relateo to the quantity ano quality ot 
iniormation describing student pertormance. Thurlow & Ysseloyke 
(1979) touno that a great ueal ot oata describing stuuent 
pertormance is collected; but much of it is technically 
inadequate and irrelevant. For example/ student observational 
data/ which is collected betore an 1EP meeting/ otten tails to 
opera tionalize behavior/ appropriately quantify behavior/ or list 
antecedent ana consequent events. These limited observational 
records have little value tor program planners. They are not 
specitic enough to direct the development ot goals and 
objectives. 

Besides inadequate data/ mu 1 ti d i sc i p 1 i na r y teams otten 
collect information irrelevant to instructional planning. Norm- 
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referenced tests, usee frequently in public schools to evaluate 
performance, can be considered i ns tr uc t iona 1 1 y irrelevant, A 
norm-reterenceu test produces a score that reflects how an 
individual's performance compares with the performance of other 
individuals. For a test to be ins true tiona 1 1 y relevant, an 
individual's perrormance must be assessed in absolute terms. 

Criterion-referenced instruments, rather than norm- 
referenced instrumen ts { assess studen t performance in speciric, 
precisely defined content areas using absolute terms (Borg & 
Gall/ 1979), Since c r i te r i on-re re rencea instruments can point 
out specific perrormance deficits, criterion- referencea cests 
can, therefore, be more useful to program planners than norm- 
referenced instruments to program planners. 

An additional problem is that many instructional planners 
have difficulty moving from data collection to writing 
instructional objectives. Translating criterion-referenced test 
data into prescriptive objectives is a difficult task. The task, 
despite its level of difficulty, is critical to appropriate 
program planning, A student's program plan should directly 
relate to his current performance. 

Autnors ana publishers of many criterion-referenced tests 
attempt to make the 30b of translating test ua ta into 
prescriptive objectives easier by providing tables which 
reference specific objectives to test performance. For example, 
Connolly, Natchman, & Pritchett (1970) provide such reference 
taoies for the Key Math Diagnostic Arithmetic test. 



In spite ot the Key Math developers 1 etforts to make the 
test prescriptive, Goodstein, Kahn & Cawley (1976) reported that 
Key Math has utility only as a preliminary screening instrument 
for assessing areas ot strength and weakness in general 
mathematics achievement* Goodstein, et al. (1976) felt that the 
usefulness ot the Key Math tor diagnosis ot mathematical 
disabilities ana the prescription of specific intervention 
tactics remained limited. Furthermore, Goodstein et el. (1976) 
described Key Math objectives as too broad-based tor most 
teachers to adequately develop a prescriptive program likely to 
meet individual student's neeus. 

Often skilled planners require more detailed and time- 
consuming, criterion-referenced test data as well as additional 
information to write suitable objectives (Colburn & McLeod, 
1983)* Many times, unskilled planners don't even Know when to 
ask tor additional information* 

Although academic objectives are an important part of most 
lEPs, social skills must also oe considered* For an IEP to be 
appropriate, objectives which relate to social skills must also 
be tied to a student's performance* This means that planners 
must translate observational data into objectives for 
social/emotional behavioral prescriptions* Since acceptable ana 
unacceptable student behavior in the classroom otten covers a 
much greater range ot circumstances than those in an academic 
area, the problems associated with social/emotional elements ot 
program planning can become very intricate. 



There are at least two issues that limit the likelihood that 
planners will write appropriate instructional objectives in both 
academic social/emotional areas. First, inappropriate data are 
often collected. Second; planners often lack expertise that 
allows them to translate good data into prescriptive objectives. 
These two issues are interrelated because persons unfamiliar with 
handling data appropriately cannot request adequate information. 
Planners neeu adequate information to write appropriate 
objectives. Without this information/ implementation of the IEP 
is severely hampered. Failing to correctly implement an IEP can 
be consioerea the most critical detriment to appropriate 
programming tor a handicapped child (Gerardi et al./ 1984). 

Artificial Intelligence: A Possible Solution 

The field of Artificial In tel 1 igence , specifically expert 
systems/ may hold solutions for the problems identified in the 
research. 

Artificial intelligence is . e part of computer science 
concerned with designing intelligent computer systems; that is/ 
systems tnat exhibit the characteristics we associate with 
intelligence in human behavior--unaerstanding ; language/ 
learning/ reasoning/ solving problems/ ana so on (Barr & 
Feigenbaum/ 19bl/ p. 3). 

Artificial intelligence systems intended to replicate 
decision-making by knowledgeable ana experienced humans are 
called expert systems. An expert system is typically set up to 
engage the user in a dialogue. This dialogue/ in many ways/ 



parallels the type of conversation a person might have with an 
expert consultant. The computer is programmed to ask the user 
questions to detail the problem or situation (Barr & Feigenbaum, 
1981). For example^ a well-known medical system tor physicians 
is MYCIN (Davis, Buchanan & Shortliffe, 1975). With MYCIN the 
user inputs data into the computer intormation on the 
characteristics ot the patient's bacterial cultures and the 
patient's symptoms. The computer is programmed to match the 
patient's data with information in the program on the 
characteristics oi bacterial cultures and then, based on 
programmed logic, present a disease diagnosis. 

Expert Systems and IEP Planning 

Two prototype expert systems, Math Test Interpreter (Lubke, 
1985) and Behavior Consultant (Ferrara & Serna, 1985) have been 
developed to test the feasibility ot applying expert systems 
technology to the task ot translating test and observational oata 
into prescriptive objectives. 

Math Test Interpreter ( MT1 ) 

The Math Test Interpreter (MTI) is designed to combine 
student intormation, results iirom the Key Math diagnostic 
Arithmetic Test (Connol ly et al., 1976) and addi tiona 1 program 
generated criterion-referenced test data to produce a 
prescription tor program planning in the area of mathematics. 

The knowledge base of the MTI contains several components: 
(a) a set ot rules to guide the consultation, (b) a master-set ot 
objectives tcom which review ana instructional oojectiveu are 
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selected, and (c) a set of criterion-referenced test items 
designed to obtain missing student information. 

The MTI asks questions to gather information and then 
analyzes the user's answers by comparing them to the rules in the 
knowledge base, when necessary, the system prints out additional 
criterion referenced test items to gather more specific 
in forma tion about a student's performance. 

behavior Consultant (BC) 

The Behavior Consul tan t (BC) program applies expert system 
technology to stuaent behavior-problems in the classroom. 
Ultimately, two videodisc components will be associated with the 
BC expert system. The overall structure for BC will include: 
(a) an initial videodisc component designed to teach effective 
skills for observing student behavior; that is, to teach 
educators ana others to be the "eyes and ears" of the system, (b) 
an expert system component designed to evaluate data troin che 
user regarding student behavior-problems ana suggest strategies 
for addressing the behavior-problems in the classroom, and (c) a 
secona videodisc component aesigned to teach effective 
implementation ot the behavior strategies recommenaea oy the 
expert system. 

Currently, the expert system component ot BC is in tha 
developmental stages while the viaeoaisc components are in the 
planning stages. Tne current version of BC is designed as a 
microcomputer-based system. Because ot the complexity 
anticipated tor later versions ot the expert system, it. will 



ultimately be moveu to a mainframe computer* This paper will 
show examples trom the current BC expert system prototype* The 
basic structure employed in the curren t version of BC wi 1 1 al so 
be used in later version^ transferred to the maintrame computer* 

Expert Systems Functioning 

Consul ta tions 

Both prototype systems described above engage the user in a 
dialogue. For example/ in the case ot MTI, the user supplies 
information about the student such as graae, data of examination, 
mental ability/ past math performance, 1Q, chronological age, 
priority ratings tor content areas, as well as item scores on ttte 
Key Math test* 'when consulting BC the user's answers to a series 
ot questions describe the behavior-problems, the condition in 
which the behavior takes place, and the condition in which the 
teacher will attempt to modify the problem behavior. 

Figures la ana lb present examples ot a typical consultation 
with each ot the expert systems. 

Knowledge Base Rules 

Both expert systems were v/ritten using a computer language 
that: organizes human knowleage into a series ot rules. These 
rul<as have two components: an "if component, or antecedent 
component, and a "then" component, or consequent component. Uhen 
the conditions in the antecedent component ot the rule match the 
conditions in the user's problem description, a conclusion in the 
consequent component ot the rule is invoked. Figure 2 present an 
"if-then" rule taken from the MTI. 
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What was the students age in months at the time the test was 

administered? 

>> 120. 

What was the students grade level at the time the test was 
administered? (Enter the score as a real number/ for example 3.5 
or 6.8.). 
>> 5.1. 

Based on your information about the student's intellectual 
functioning (IQ)/ this student would be considered: 
-normally functioning (that is# above 75) 
-intellectually handicapped (about 55-75) 
-severely-in tellectually handicapped (below 60) 
>> intellectually handicapped. 

The three basic areas covered by the Key Math test are Content/ 

Operations and Applications. 

Please rate the CONTENT area in terms of priority/ 
using a 1/ 2, 3/ with a "1" being the highest priority. 

>> 2. 

Please rate the OPERATIONS area in terms of priority/ 

>> 3. 

Please rate the APPLICATIONS area in terms of priority/ 

>> 1. 

How much time is devoted to mathematics instruction per day for 
this student? (Please enter the average amount of time per day 
in minutes). 
>> 40. 

Figure la. Typical consultation with the Math Test Interpreter 
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What is the behavior which you wish to stop or retard? 
> > talking-in-class . 



Is there a good behavior which is incompatible with talking-in- 
class? (For example/ speaking normally is incompatible with 
yelling. Working on math worksheets/ on the other hand/ is NOT 
incompatible with making strange noises). 
>> no. 

How quickly must the talking-in-class be stopped? 

1. RIGHT AWAY! This talking-in-class is an immediate 

threat to the physical well-being of someone, (e.g./ 
head-banging ) . 

2. Quickly. This talking-in-class is making my life an^/or 
the lives of the other kids miserable. (e.g./ 
screaming ) • 

3. There is no big rush/ but I'd like to stop the talking- 

in-class as soon as I can. (e.g./ talking in class). 

4. The talking-in-class is only an annoyance. There is no 

need for a major effort to control it. (eg. 4 nose- 
picking) . 

>> 3. 

What consequent do you think is maintaining the talking-in-class? 
>> teacher-attention . 

Can the teacher control the teacher-attention which appears to be 
maintaining the talking-in-class behavior? 
>> yes. 

On a scale of 1 to 50/ does the student enjoy being in the 
classroom where the talking-in-class is taking place? 

He/she finds this The classroom is among 

to be an aversive place. this child's favorite place 



-50 



>>40. 

On a scale of 1 to 50/ does the student enjoy the activities 
taking place in the classroom while the talking-in-class is 
happening? 

He/she finds these These activities are 

activities to be aversive among this child's favorites 



•50 



>> 40. 



Figure lb. Typical consultation with the Behavior Consultant 
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If IQ = " ^llectually handicapped/ and 

age = AGE 

AGE = > 13/ and 

PAST PERFORMANCE ■ poor 
Then EXPECTED PROGRESS = 7.5 month3 



Figure 2. An example of a rule from Math Te3t Interpreter, 
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MTI and BC programs contain factual and heuristic rules. 
Factual Knowledge consists of information that can be documented, 
such as state and federal regulations and proven hypotheses 
(Feigenoaum & McCorduck, 1983). An example of a strictly factual 
rule would involve the calculation ot the student's mental age 
based on the IQ and the chronological age input by the user. 

Heuristic knowledge captures the "rule of thumb 11 experiences 
or humans. In special education, such knowledge might come trom 
expert diagnosticians or instructors. Reterring to the rule 
presented in Figure 2, it may be the heuristic opinion ot several 
experts that under the circumstances described in the antecedent 
parts ot the rule, a stuoent would likely make seven ana one-hait 
months progress. 

Back Chaining 

Both MTI and BC expert systems use back chaining. This 
is a problem-solving tecnnique which works backward from 
hypothesized conclusions to known facts. Thus, the expert system 
can determine it rules succeed or fail. For example, when 
testing the rule stated in Figure 2, MTI first seeks a value for 
the expression for "1Q." Then values tor the expressions "AGE" 
a no "PAST PERFORMANCE" will be sought. Thus, if all the 
conditions ot a rule are confirmed, the conclusion is confirmed 
and the rule succeeds. Conversely, if any of the conditions in a 
rule cannot be confirmee, the conclusion cannot be confirmed and 
the rule tails. 

There are three ways in which MTI and BC seek values for the 
expressions within rules. These systems' value-seeking behaviors 
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are illustrated in Figure 3. When one system seeks a value for 
an expression within a rule; it will first check to see it it 
already knows the value. If it has previously asked or inferred 
the expressions value it will be stored in the system's global 
memory. It the system looks in the global memory and finds a 
value for the expression, it will stop looking ana use that value 
to test the rule. If a value for the expression is not found in 
the global memory, the system will then seek rules which conclude 
with a value for the expression. The system will then test this 
next set of rules to identify the value or the expression. 
Finally, if there are no rules which conclude with a value for 
the expression, or it all such rules fail, the system will ask 
the user if he/she knows the expressions value. 

Figure 4 shows how BC tests a rule, which concludes that 
time-out is an appropriate procedure for modifying "throwing 
objects" behavior. The steps used by BC in this situation are 
detailed below. 

1. BC seeks a value for the expression "bad -be ha v ior " in 
the global memory (the global memory contains 
information already acquired by asking the user 
questions ) . 

2. Since the computer already had a value for bad-behavior 
3toreu in the global memory it returns the value 
"throwing" for the expression "bad-behavior." The 
expression "B" found in this condition indicates a 
variable. Thus , the value "throwing" is associated 
with the variable "B." 



3. Next/ BC seeks a value for the expression H speed ( B) , " 
that is, a value tor the "speed at which throwing must 
be stopped." BC finds rules concl uding wi th "then 
speed(B)" and tests the first condition of the first 
rule • 

4. BC seeks a value for the expression "bad-behavior" in 
the global memory. 

5. BC returns the value "throwing" for the expression "baa- 
behavior . " 

6. Because quickness does not have a value in the global 
memory the system seeks a value for the expression 
"quickness(B)" by asking the user a question. 

7. BC returns the user's value "l-rea 1-f ast" for the 
expression "qui c kne ss ( B) ." Because the user's value 
"1-real-fast" does not match the value "4-rea 1 -s low" , 
this rule fails. 

8. BC enters "l-rea 1 -fas t" in the global memory as the 
value tor the expression "quickness(B)." 

9. BC considers the next rule concluaing "then speed(B)" 
and seeks a value ror the expressions "bad-behavior" 
and "quickness(B)" in the global memory. 

lio. BC returns "throwing" and "l-rea 1 -tast" as the valuer 
for the expressions "bad-behavior" and "quickness( b)" 
respectively. 

11. The rule concluding "then speed(B) = tast" succeeds. 

12. The condition or the original rule stating "and speeo(B) 
= fa3 t" ia confirmed. 
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13. bC seeks values tor the expressions in the remaining 
conditions ot the rule, that is, " time-ou t-ra tio" and 
M chi ld-charac teris tics. 11 It finds these values either 
in the global memory, by testing rules/ or by asking 
the user* 

14. The rule succeeds or tails depending on the outcome ot 
the expressions in the premises. 

Possible System Outcomes 

Inadequa te inf or ma tion . Both BC ana Mil can identity 
situations in which the aa ta provided by the user either is 
inconsistent, lacks validity, or is incomplete. In situations 
where this is trie case, the system will alert the user and 
suggest that additional intormation should be obtained. MTI 
will, in certain cases, print out specific criterion-referenced 
test items to be administered to the student. Two options are 
available at this point; the user may continue with the 
consultation, or the user may abort the consultations and gather 
the intormation needed to make a complete diagnosis and 
prescription. Figure 5 describes the output ot this section ot 
the MTI consultation process. 

0b2£ct£ves. Both MTI and BC are designed to print 
objectives for ILP development. MTI presents the user with two 
types ot objectives, re view objectives and instructional 
objectives. Review objectives cover those isolated skills a 
student appears to be lacking. The instructional objectives 
correspond with the level of the test items that tall at or above 
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Check Global 
Memory 




If the information 
is not in the memory 



Try Rules Concluding 
With The Expression 




Figure 3. Three ways to obtain a 'value for an expression. 
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question(quickness(B)) ~f 



How quick// must the 'M 9 be stopped? 

t Right away! This \BL 'is an immediate threat to the physical 
well-being of someone, (eg. headbangingX 

2. Quickly. This IB. *is making my life and/or the lives of the other 
kids miserabfefeg* screemingX 

3. There is no big rush but Id like to stop the 'M as soon as 
lcan(eg* talking in class/. 9 

4. The is only an annoyance There really is no need for 
a major effort to control it (eg, nose-picking)'}d 

legah/als(quickness(R)) — [1 -r*aj-fa*^-pretty-fast, 3-pretty-shw. 



4-real-slowJ 
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What is the value of item 4? (Enter a "1" if the student 
responded correctly to this item and a "0 W if he/she failed to 
respond correctly). 
>> 1. 

What is the value of item 5? 
>> 1. 

What is the value of item 6? 
>> 1. 

What is the value of item 7? 
>> 0. 

In order to determine the appropriate prescriptive objectives 
dealing with Identification and Addition of Coins and Currency/ I 
need more information. It would be helpful if you would 
administer the following short criterion-referenced check with 
your student. 



(Prints out check-test items on the printer )• 



Would you like to STOP and continue with this consultation at a 
later time or would you prefer to GO ON with the consultation 
without using the additional information? 
> > STOP . 



Figure 5. An example of a request for additional data from 
Math Test Interpreter. 
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the student's ceiling level* A students ceiling level occurs 
when he/she has made three consecutive errors on the Key Math 
test. Figure 6 shows the screen display of the type of message 
presented to the user at the ena of the consultation along with 
the appropriate objectives. These review and instructional 
objectives would be appropriate to include as short-term 
objectives in a student's IEP. 

BC provides terminal objectives as well as an explanation ot 
step-by-step procedures tor achieving those objectives. When the 
entire BC system is finally completed in 1989/ the computer will 
use an interactive videodisc to teach an instructor how to 
implement the suggested procedures. 

Other General Features of Expert Systems 

The M.l authoring system (Teknowledge , 1984) was used to 
create both MT1 and BC. M.l has several features which make the 
system particularly attractive to educators. 

1. The "TRACE" facility allows the user to monitor the 

computer logic as it attempts to provide advice. 

2. The "WHY" facility allows the user to question the 

program about "why" it asked a question. The machine's 
response can be an M.l rule/ an English translation of 
an M.l rule, or a reference to state ana/or federal 
law. 

3. The "ShOV<" facility allows the user to query the 
program at any point in the consultation regarding its 
intermedia te concl us ions. 
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The student needs to review the following objectives: 

3-A The student will verbally state in "cents" the value of 
a penny* 

3- B The student wi 1 1 coun t out up to 20 pennies and 

verbally state the amount as pennies* 

4- C Given a nickel and five pennies the student will pcik 

out any combination of cents up to ten cents upon 
verbal instruction* 



The f ol lowing objectives are considered appropria te for the 
students instructional level: 

6-A The student will be able to match each amount with the 
correct corresponding amount written when using a 
dollar sign and a decimal point/ given a worksheet with 
amounts written in cent form in one column* 

6-B The student will be able to match the numerical values 
of money word values/ such a $.50 with fifty cents* 

6- C The student will be able to write the following 

dictated amounts using a dollar sign and decimal 
point— $1.20/ $.75/ $2.68, $.62/ and $.05. 

7- A The student will be able to select the quarter when 

directed to do so/ given sets of coins containing 
pennies/ nickels/ dimes and quarters. 

7-B The student will be able to indicate that another name 
for a quarter is 25 cents when shown a quarter. 

7-C The student will be able to identify the one coin which 
is worth 25 cents when given sets of coins containing 
pennies/ nickels/ dimes and quarters. 



Figure 6. Output of prescriptive objectives from the Math Test 
Interpreter 
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Summa ry ana Conclusions 

Expert systems and specia l education . Recent efforts to 
apply expert systems to the problems in special education 
represent a truly difterent approach. Considerable research is 
needeo betore tirm conclusions can be reached regarding the value 
ot expert systems tor handicapped chi ldren. There are / however / 
some preliminary tindings that indicate that this line of 
research is warranted (Hotmeister & Lubke/ in press). 

1. Evaluations conducted with prototypes indicate that 

these systems can perform as well as humans in specitic 
areas. 

2. Some ot the problems faced by special educators are 

similar to the problems faced in other disciplines 
where expert systems have been successful. 

3. The process ot assembling and organizing knowledge bases 

tor expert systems is a productive activity in its own 
right. The development of the "if-then" rules of a 
knowledge base clarifies existing knowledge and 
identities areas where knowledge is needed. 

Intejra tin£ expert s ystems into the IEP process . Paper 
compliance is relatively easy/ that is/ given the time-tactor/ 
tulfilling the "letter ot the law" in writing IEPa can be 
accomplished with little effort. But/ making a oitterence in 
the quality ot a handicapped child's education/ is a challenge 
that involves tultilling the "spirit ot the law." It is 
anticipated that expert systems like Mil and BC can upgrade the 
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quality ot the IEP3 produced tor handicapped children. With 
appropriate, clearly-stated objectives providers can plan daily 
instruction lessons that relate directly to the identified needs 
of their students. Today's handicapped children have "more 
rights 11 but the price they pay should not be "less quality 
education" (Gerarai et al. f 1984). 
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